🏠 Self-hosted AI

Model Optimization, Inference Engines, LLM Quantization, Privacy-focused Deployments

ReflectivePrompt: Reflective evolution in autoprompting algorithms
arxiv.org·5h
🏗️AI Infrastructure
Paradigms of Intelligence Team
github.com·19h·
Discuss: Hacker News
🏗️AI Infrastructure
Block unsafe prompts targeting your LLM endpoints with Firewall for AI
blog.cloudflare.com·19h
🤖AI agents
vLLM Performance Tuning: The Ultimate Guide to xPU Inference Configuration
cloud.google.com·1d
🏗️AI Infrastructure
Best Practices for Securing Generative AI with SASE - The Cloudflare Blog
news.google.com·20h
🤖AI agents
LLM System Design and Model Selection
oreilly.com·23h
🏗️AI Infrastructure
Build and deploy small AI models from the browser
blog.minibase.ai·1d·
Discuss: Hacker News
🏗️AI Infrastructure
vLLM on x86: Because Not Everyone Can Afford a GPU Cluster
dev.to·22h·
Discuss: DEV
🏗️AI Infrastructure
ISACL: Internal State Analyzer for Copyrighted Training Data Leakage
arxiv.org·1d
💻Local LLMs
Latent Self-Consistency for Reliable Majority-Set Selection in Short- and Long-Answer Reasoning
arxiv.org·5h
💻Local LLMs
Why Agentic AI Relies on Your Database
singlestore.com·1d
🏗️AI Infrastructure
PRISM: Robust VLM Alignment with Principled Reasoning for Integrated Safety in Multimodality
arxiv.org·5h
🏗️AI Infrastructure
Enterprise essentials for generative AI
infoworld.com·2d
🧩Low-code
Deep Think with Confidence
arxiviq.substack.com·2d·
Discuss: Substack
💻Local LLMs
History Rhymes: Accelerating LLM Reinforcement Learning with RhymeRL
arxiv.org·5h
🏗️AI Infrastructure
LLM Monitoring and Observability: Hands-on with Langfuse
towardsdatascience.com·1d
💬Language Servers
Federated Learning with Heterogeneous and Private Label Sets
arxiv.org·5h
🤝Federated Learning
Auditing Approximate Machine Unlearning for Differentially Private Models
arxiv.org·5h
💻Local LLMs
ALAS: Autonomous Learning Agent for Self-Updating Language Models
arxiv.org·2d
💻Local LLMs
Generative Interfaces for Language Models
arxiv.org·5h
🎤Voice Interfaces